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SECTION  1 


INTRODUCTION 


Since  1982,  the  Air  Force  Electronic  Systems  Division  (ESD)  and  The  MITRE  Cor¬ 
poration  have  supported  the  Air  Force  Logistics  Command  (AFLC)  in  developing  and 
implementing  local  area  networks  (LANs)  at  the  AFLC  Headquarters  located  in  Dayton, 

Ohio  and  Five  Air  Logistics  Centers  (ALCs)  located  in  Warner  Robins,  Georgia;  San  Anto¬ 
nio,  Texas;  Oklahoma  City,  Oklahoma;  Ogden,  Utah;  and  Sacramento,  California.  ESD  was 
assigned  overall  responsibility  for  system  acquisition  with  MITRE  designated  as  the  general 
system  engineer. 


1.1  BACKGROUND 

AFLC  has  undertaken  the  task  of  updating,  augmenting  and  replacing  many  of  its 
data  processing  and  communications  facilities  under  the  auspices  of  the  Logistics  Manage¬ 
ment  Systems  (LMS)  modernization  program.  More  than  150  systems  will  be  modernized 
under  this  program.  A  limited  number  of  these  will  be  substantial  data  processing  systems  at 
several  sites  with  significant  communications  requirements.  These  systems  have  been 
identified  as  the  baseline  LMS.  A  LAN) is  being  installed  at  each  of  the  AFLC. ALCs  to  sup¬ 
port  the  LMS  modernization  program.  The  terminals  and  printers  of  these  systems  will 
communicate  with  host  computers  through  the  LAN. 

In  September  1985,  TRW  Systems  Engineering  and  Development  Division  (SEDD) 
was  awarded  a  contract  to  implement  the  LANs  at  the  five  ALCs.  The  LANs,  which  will 
provide  basewide  data  and  video  communications  for  the  LMS  at  the  ALCs,  are  unusually 
large.  Each  LAN  spans  25  to  85  buildings,  in  some  cases  located  miles  apart.  About 
20,000  outlets  are  being  provided  on  each  LAN  to  support  approximately  7000  user  devices. 
These  LANs  are  an  order  of  magnitude  larger  than  any  currently  in  operation. 

Various  subcontractors  are  installing  the  cable  plants  in  a  series  of  five  blocks  of 
interbuilding  trunking  and  intrabuilding  cable  plants.  TRW  Information  Networks  Division 
(1ND)  has  provided  the  network  interface  units  (NIUs).  The  NIUs  on  contract  consist  of 
ut.itnitcrcia!  ....'f  the  shelf  (CCTS)  asynchronous  NIUs  synchronous  NIUs,  and  bridge 
units. 


The  ALC  LANs  include  numerous  terminals  and  printers  distributed  across  the  many 
buildings  on  each  base.  Users  working  on  the  large,  centrally  located  database  management 
systems  must  access  multiple  hosts  from  single  terminals.  Many  of  the  candidate  systems 
for  connection  to  tiie  1  ANs  either  have  not  been  procured  or  the  hardware  has  not  been 
selected.  This  has  led  to  some  uncertainty  about  the  use  ot  the  LANs,  the  amount  of  traffic 
loading,  and  the  amount  of  growth  expected  in  the  short-  and  long-term  life  of  the  LANs. 
Even  now,  after  most  of  the  cable  plants  have  been  installed  and  some  LMS  programs  have 
been  connected,  the  work  load  and  specific  numbers  of  tenninal/host  types  are  largely 
unknown. 
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In  1986,  in  support  of  the  ALC  LAN  architecture,  TRW  developed  an  analytical 
nuxlel  to  predict  the  performance  of  the  LANs  under  specified  loading.  Since  the  actual 
system  could  not  be  tested  because  it  was  not  fully  installed,  analytical  models  or  simulations 
were  the  only  tools  available  to  predict  network  performance.  Analytical  models  are  feasible 
only  with  the  use  of  highly  simplified  assumptions.  Even  then,  analytical  models  can  model 
only  a  limited  number  of  variables  present  in  the  actual  system.  Furthermore,  model  results 
are  highly  dependent  on  the  accuracy  and  comprehensiveness  of  the  assumptions.  The  criti 
cal  issue  for  the  ALC  LANs  was  whether  the  statistical  nature  of  the  network  communication 
protocol  would  drive  the  number  of  required  network  channels  beyond  the  number  recom¬ 
mended  in  the  analytical  model.  A  larger  number  of  channels  would  impact  the  cost  and 
complexity  of  the  system. 

MITRE  recommended  a  set  of  tests  to  examine  this  issue  because  the  fidelity  of  the 
TRW  SEDD  analytical  model  did  not  adequately  characterize  the  statistical  performance  of 
individual  network  channels  based  on  the  traffic  described  in  the  system  specification.  Al¬ 
though  this  testing  was  outside  the  scope  ot  the  ALC  LAN  contract,  TRW  agreed  to  proceed 
with  MITRE's  recommendation.  This  led  to  TRW  SEDD,  TRW  1ND,  and  the  MITRE 
Corporation  collaborating  on  a  series  of  N1U  performance  tests  to  understand  the 
performance  characteristics  of  the  asynchronous  and  bridge  NIUs  and  their  impact  on  the 
system  architecture. 


1.2  SCOPE  OF  DOCUMENT 

This  document  reports  on  the  investigation  of  network  channel  performance  charac¬ 
teristics  for  the  ALC  LAN  asynchronous  and  bridge  NIUs.  A  scaled  broadband  network 
was  used  to  simulate  ALC  LAN  network  environments  to  examine  channel  loading  capacities 
and  end-to-end  delay  behavior  under  various  traffic  load  conditions.  Testing  also  character¬ 
ized  the  carrier  sense  multiple  access  (CSMA)  w  ith  priority  acknowledgement  protocol  used 
by  the  TRW  IND  NIUs. 

Section  2  states  the  overall  test  goals.  Section  3  describes  the  traffic  characteristics 
assumed  in  the  tests.  Section  4  defines  the  test  phases,  their  objectives,  test  configuration, 
test  composition,  and  approach.  Section  5  summarizes  the  test  results.  The  hist  section  pre¬ 
sents  conclusions. 


SECTION  2 


TEST  COALS 


A  system  performance  test  was  conducted  to  refine  the  existing  analytical  model  to 
better  predict  system  performance.  The  goals  were  threefold: 

a)  to  characterize  the  NIU  protocol  (because  it  was  not  well  documented); 

b)  to  determine  channel  capacity; 

c)  to  determine  how  sensitive  channel  capacity  is  to  various  types  of  traffic. 

In  addition,  an  effort  was  made  to  develop  tools  for  predicting  network  performance  for 
various  types  of  traffic. 
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SECTION  3 


TRAFFIC  DESCRIPTION 


Each  of  the  ALC  networks  are  required  to  support  interconnection  services  for  5(>00 
terminals,  1120  printers  and  6720  host  computer  ports.  Multiple  data  channels  will  be 
needed  to  handle  the  expected  traffic  from  this  large  number  of  devices.  Most  of  the  trai  l  ic¬ 
on  the  LAN  will  be  either  terminal-to-host  or  printer-to-host  with  only  a  minimal  amount  of 
traffic  expected  between  terminals  or  workstations.  A  large  amount  of  the  traffic  will  be  to 
and  from  a  large,  centrally  located  computer  center.  Given  the  large  physical  size  of  the 
L  ANs  and  resulting  long  propagation  delays,  users  will  be  divided  into  subnetworks  to 
optimize  performance.  To  provide  universal  connectivity,  large  numbers  of  bridge  NILs 
will  connect  the  users  operating  on  different  channels  or  in  different  subnetworks.  The 
performance  of  NIUs  and  bridges  under  load  is  critical  to  the  assurance  of  efficient  operation 
of  the  LANs.  This  section  defines  the  seven  types  of  traffic,  the  system  specification  and  the 
word  processing  traffic,  used  in  the  simulation  of  system  performance. 


3.1  SYSTEM  SPECIFICATION  TRAFFIC 

The  ALC  LAN  System  Specification  defined  the  traffic  load  for  each  LAN  based  on 
the  number  and  type  of  probable  devices  located  at  each  ALC.  This  load  model  specified 
traffic  in  four  types  to  correspond  with  the  devices  that  were  expected  to  operate  on  the 
l.ANs  at  the  ALCs.  The  load  model  also  stated  the  amount  of  traffic  that  would  need  to  be 
bridged  from  one  subnetwork  to  another. 

The  traffic  was  divided  into  two  categories:  terminal  traffic  and  printer  traffic.  The 
terminal  traffic  was  expected  to  be  transactional,  since  most  of  the  baseline  LMS  are  database 
management  applications  that  will  evoke  transactional  traffic  on  the  LAN.  It  was  assumed 
that  75  percent  of  the  terminal  traffic  would  be  between  the  terminals  and  the  host  computers 
located  in  the  computer  center.  The  remaining  25  percent  of  the  terminal  traffic  would  be 
distributed  randomly  on  the  LAN. 

The  printers  were  expected  to  be  medium  speed  line  printers.  Printer  traffic  was 
specified  to  be  one-way  from  a  host  or  workstation  to  a  printer.  Printers  were  to  be  dis¬ 
tributed  randomly  about  the  LAN. 

The  system  specification,  therefore,  defined  four  types  of  traffic:  Type  1  -  echoplex 
transactional  terminal;  Type  II  -  line-oriented  transactional  terminal;  Type  Ill  -  echoplex  data 
entry  terminal;  and  Type  IV  -  printer.  The  following  paragraphs  describe  the  four  types  of 
traffic. 
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3.1.1  Echoplex  Transactional  Terminal  Traffic 


Echoplex  transactional  terminal  traffic  is  defined  a1'  Type  1.  This  type  of  traffic  rep¬ 
resents  an  implementation  of  transactional  traffic  on  echoplex  devices  such  as  asynchronous 
ASCII  terminals  or  w<  rkstatio*is  in  asynchronous  emulation  mode. 

Type  1  terminal  traffic  is  characterized  for  a  transaction  every  two  minutes  during  a 
75  percent  duty  cycle  Each  transaction  consists  of  tf  e  transmission  of  SO  bytes  of  data 
from  the  terminal  to  host  in  echoplex  mode  followed  by  a  full  screen  echoplex  response  of 
1920  bytes  of  data  from  the  host  to  the  terminal.  It  was  expected  that  up  to  1400  Type  1 
terminals  would  be  connected  to  the  LAN  at  each  ALC. 

3.1.2  Line-Oriented  Transactional  Terminal  Traffic 

Line-oriented  transactiona.  terminal  traffic  is  defined  as  Type  2.  This  type  of  traffic 
would  lie  typical  of  most  block-mode  asynchronous  terminals  and  almost  all  synchronous 
temiinals. 

Type  2  terminal  traffic  is  characterized  by  a  transaction  of  80  bytes  every  two  minutes 
during  a  75  percent  duty  cycle.  After  the  SO  byte  block  has  been  successfully  transmitted  to 
the  host,  the  host  responds  by  transmitting  1920  bytes  of  data  to  the  terminal.  Type  2  traffic 
is  similar  to  Type  1  except  that  the  transactions  are  not  echoplex,  it  was  expected  that  up  to 
2S00  Typo  2  temiinals  would  be  connected  to  the  LAN  at  each  ALC. 

3.1.3  Echoplex  Data  Entry  Terminal  Traffic 

Echoplex  data  entry  terminal  traffic  is  defined  as  Type  3.  This  traffic  is  typical  of  a 
data  entry  operator  typing  non-stop  into  an  echoplex  terminal  at  a  rate  of  30  words  per 
minute  (wpm). 

Type  3  terminal  traffic  is  characterized  by  a  360  byte  echoplex  transaction  every  two 
minutes  during  a  75  percent  duty  cycle.  This  translates  to  three  characters  every  second 
where  each  character  must  be  echoed  from  the  host  before  it  is  displayed  at  tue  terminal.  It 
was  expected  that  up  to  14(H)  Type  3  temiinals  would  be  connected  to  the  LAN  at  each  ALC'. 

3.1.4  Printer  Traffic 

Printer  traffic  is  based  on  a  medium  speed  line  printer  that  receives  and  prints  two 
million  bytes  of  data  per  hour  while  active  50  percent  of  the  time.  The  two  million  bytes  of 
data  is  about  500  pages  on  a  printer  operating  at  400  lines  per  minute.  It  was  expected  that 
up  to  1 1 20  of  these  printers  would  be  connected  to  the  LAN  at  each  ALC. 

3.2  ADDITIONAL  TRAFFIC 

Three  additional  traffic  transaction  types  were  defined  during  the  course  of  the  testing 
to  explore  the  effects  of  and  sensitivity  of  performance  to  traffic  that  might  be  encountered  at 
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the  ALCs,  but  which  had  not  been  included  in  the  system  specification.  These  traffic  trans¬ 
action  types  represent  components  of  a  typical  word  processing  environment.  They  are 
based  on  TRW  IND's  observations  of  individuals  in  typical  office  environment. 

TRW  IND  observed  secretaries  using  word  processing  software  packages  executed 
on  a  host  computer.  Rach  secretary  was  allocated  a  terminal  which  could  display  up  to  X() 
characters  per  line,  24  lines  per  screen.  When  a  hard  copy  of  a  file  was  needed,  the  user 
spooled  'he  document  file  to  a  printer  that  printed  on  single  X.5"  by  1 1"  sheets  of  paper.  The 
printer  also  had  sufficient  memory  to  buffer  one  page  of  text.  All  terminals  and  printers  were 
connected  to  the  host  computer  using  9600  bit  per  second  (bps)  asynchronous  connections. 
Rach  user  was  sufficiently  familiar  with  the  basic  operations  to  perform  all  word  processing 
functions. 

TRW  IND  observed  that  a  typical  word  processing  task  began  with  data  entry  into 
the  computer  from  a  hand  written  transcript.  Once  data  entry  was  completed,  the  file  was 
spooled  to  a  printer  for  a  hard  copy  proof.  The  users  primarily  worked  on  memoranda  and 
short  documents  with  an  average  length  of  five  pages  of  60  character  lines  printed  on  a  stan¬ 
dard  sheet  of  paper.  The  hard  copy  was  then  reviewed  and  edited  by  its  originator.  The 
marked-up  copy  was  returned  to  the  secretary,  the  document  file  revised,  and  the  final  copy 
printed. 


Word  processing  users  divided  their  time,  on  average,  among  three  modes: 

a.  DATA  ENTRY  consumed  50  percent  of  an  active  user's  time.  This  mode 
involved  entering  text  from  the  keyboard  of  a  terminal.  The  terminal  operated  in 
echoplex  mode. 

b.  EDITING  was  performed  25  percent  of  the  time.  Users  would  page  through  a 
text  file  to  the  desired  screen  of  text,  and  then  move  the  cursor  to  the  location 
requiring  editing.  Editing  typically  involved  insertion  of  text  or  spelling 
corrections.  However,  paging  through  the  document  to  proof  text  was  also 
considered  editing.  The  average  editing  rate  was  one  full  screen  of  text  per 
minute  at  the  terminal. 

c.  IDLE  TIME,  the  time  the  user  was  not  actively  typing  at  the  keyboard,  accounted 
for  25  percent  of  the  user's  time. 

It  was  also  noted  that  in  an  office  environment,  word  processing  users  had  various 
skill  levels.  Observed  differences  between  users  included  general  facility  with  the  word 
processing  software,  familiarity  with  specific  word  processing  functions,  typing  speed,  and 
typing  accuracy.  Of  these,  typing  speed  would  significantly  affect  the  traffic  load.  There¬ 
fore,  it  was  necessary  to  divide  the  word  processing  users  into  two  types,  average  users  and 
power  users. 

An  average  user  was  one  who  typed  at  40  wpm.  This  rate  offered  a  load  of  4 
characters  per  second  (cps)  to  the  network.  Seven  out  of  eight  users  w  ere  classified  as 
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average  users.  Collectively,  seven  average  users  printed  seven  documents  over  a  75  minute 
period. 


Power  users,  the  remaining  one  user  out  of  e<ght,  typed  at  a  rate  of  60  wpm.  This 
rate  offered  a  load  of  six  cps  to  the  network.  One  power  user  printed  one  document  every  60 
minutes. 

To  develop  the  additional  traffic  transaction  types,  it  was  assumed  that  four  of  the 
eight  word  processing  users  would  be  engaged  in  data  entry  tasks  and  the  other  four  in  edit¬ 
ing  tasks.  Furthermore,  it  was  assumed  that  nearly  all  of  a  user's  idle  time  would  occur 
during  editing  rather  than  during  data  entry. 

During  the  50  percent  of  the  time  spent  in  edit/idle  mode,  users  performed  tw'o 
functions:  cursor  movement  (scrolling  and  paging)  and  data  entry.  The  load  which  resulted 
from  scrolling  was  estimated  as  twice  the  load  due  to  data  entry  since  scrolling  was 
performed  by  continuously  depressing  a  cursor  movement  key  which  automatically  repeated 
at  ten  cps.  Therefore,  if  half  of  the  edit/idle  cycle  created  a  load  which  was  twice  the  data 
entry  load,  and  the  other  half  created  no  load,  then  the  average  load  for  edit/idle  tasks  was 
equal  to  the  load  for  data  entry.  The  load  which  resulted  from  paging  created  a  significant 
additional  load. 

Thus,  the  eight  user  activities  were  considered  equivalent  and  a  single  scenario  was 
used  to  emulate  the  data  entry  and  editing  functions  of  each  member  of  the  group.  Separate 
traffic  transaction  types  for  paging  and  printing  were  developed.  The  word  processing  envi¬ 
ronment  was  therefore  divided  into  three  types  of  traffic:  data  entry,  paging,  and  printing. 
The  following  paragraphs  define  the  three  additional  types  of  traffic. 

3.2.1  Data  Entry  Traffic- 

Data  entry  traffic  represents  80  percent  of  the  population.  To  simplify  the  traffic,  the 
power  user  and  average  user  data  entry  loads  were  merged  into  this  single  type.  This  group 
offers  continuous  five  cps  — rounded  up  from  4.25  cps  —  echoplex  traffic  between  a 
terminal  and  a  host  at  one  second  intervals  during  a  50  percent  duty  cycle. 

3.2.2  Screen  Refresh  Traffic 

Screen  refresh  traffic  represents  10  percent  of  the  population.  In  an  actual  word 
processing  environment,  a  terminal  transmits  a  three  character  escape  sequence  when  the 
page  up/down  key  is  pressed  at  the  keyboard.  Upon  receiving  this  sequence,  the  host 
computer  transmits  a  full  screen  of  text.  A  full  screen  of  text  is  24  lines  of  73  characters  per 
line  for  a  maximum  1752  characters.  Therefore,  this  group  offers  three  cps  from  the 
terminal  to  the  host.  The  host  responds  by  transmitting  a  continuous  burst  stream  of  1752 
characters.  This  traffic  is  processed  at  60  second  intervals  during  a  25  percent  duty  cycle. 
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3.2.3  Printer  Traffic 


The  observed  primers  could  not  print  at  the  rate  of  960  cps  (continuous  9600  bps 
stream),  and  regular  flow  controls  to  throttle  the  data  rate  were  observed.  The  printers  all 
had  sufficient  memory  to  buffer  a  page  of  text.  The  typical  traffic  pattern  was  a  burst  of  data 
(a  page);  a  pause  while  the  printer  flow  controlled  to  catch  up  with  printing  duties  or  to  wait 
for  a  page  to  be  ejected  from  the  printer,  and  the  next  page  fed;  followed  by  the  next  burst  of 
data  (the  next  page).  The  maximum  page  size  was  60  lines  of  73  character  text. 

To  determine  the  rate  at  which  users  could  offer  print  jobs,  it  was  necessary  to  look 
at  the  two  types  of  users,  the  average  user  and  the  power  user.  The  power  user  could  enter  a 
5  page  document  every  3650  seconds,  thereby  offering  one  document  an  hour  to  the  printer. 
The  average  user  could  enter  a  five  page  document  every  5475  seconds,  thereby  offering  0.7 
of  a  document  every  hour.  The  offered  print  rate  for  the  group  of  eight  users  is  5.9 
documents  an  hour  or  about  one  document  every  ten  minutes.  If  the  printers  operated  at  a 
continuous  rate  rather  than  in  one  page  bursts,  this  would  be  equivalent  to  36  cps.  Instead,  it 
was  necessary  to  derive  the  load  in  the  following  way: 

Capacity  of  9600  bps  line  =  960  cps 

Offered  load  =  5.9  documents/hour  =  129,210  char/hour  =  35.9  cps 

Duty  cycle  =  35.9  cps/960  cps  =  3.7%  =  -4% 

Page  Tx  duration  =  4380  char/page/960  cps  =  4.6  sec  =  ~5  sec 

It  was  assumed  that  the  printer  traffic  represents  ten  percent  of  the  population. 

Printers  offer  a  continuous  stream  of  4380  characters  every  five  seconds  during  a  four 
percent  duty  cycle. 
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SECTION  4 
TEST  PHASES 


This  section  describes  the  three  test  phases:  NIU  protocol  characterization,  network 
external  load  evaluation  and  end-to-end  delay  performance,  and  NRJ  parameter  sensitivity 
evaluation.  The  tests  used  the  asynchronous  and  bridge  NIUs. 

The  testing  derived  quantitative  information  on  network  channel  performance  for  the 
ALC  LAN  NIUs.  The  tests  were  defined  and  conducted  by  the  test  team  consisting  of  TRW 
SEDD,  TRW  IND,  and  MITRE.  MITRE  contributed  the  test  plan/procedures  and  the  end- 
to-end  delay  software  program  to  perform  the  end-to-end  delay  testing.  TRW  IND  developed 
the  specific  procedures  used  during  the  testing,  set  up  the  scaled  broadband  network,  and 
provided  the  necessary  test  equipment.  All  three  parties  participated  in  the  conduct  of  the 
test;  all  test  events  were  recorded  by  TRW  IND  in  an  engineering  notebook. 


4.1  NIU  PROTOCOL  CHARACTERIZATION 

The  ALC  LAN  NIUs  (excluding  the  bridge  NIU)  use  a  non-persistent  CSMA  proto¬ 
col  with  priority  acknowledgement  for  communicating  over  the  broadband  network.  Micro¬ 
processor  based  NIUs  perform  the  required  protocols  to  maintain  virtual  circuits  over  the 
network.  The  NIUs  use  vestigial  side-band  amplitude  modulation  encoding  data  at  two 
million  bps  (Mbps)  with  the  Non-Return  to  Zero  Inverted  (NRZI)  with  zero  insertion 
scheme. 

The  bridge  NIU  is  essentially  a  packet  filter  which  selectively  passes  packets  from 
one  channel  to  another  with  destination  addresses  that  are  within  the  specified  range  set  in  the 
bridge.  All  virtual  circuit  support  is  passed  transparently  through  the  bridge  NIU. 

NIU  packet  formats  are  unique  to  the  TRW  IND  implementation  of  this  protocol. 
Each  packet  can  be  separated  into  five  different  parts:  leading  flags;  header  field;  0  to  256 
byte  information  field;  CRC;  and  trailing  flags. 

4.1.1  Objectives 

There  were  four  main  objectives  of  the  NIU  protocol  characterization  test: 

a)  to  characterize  the  packet  transmission  of  different  packet  types  (the  number  of 
leading  flags,  length  of  packet  contents,  and  number  of  trailing  flags); 

b)  to  measure  the  packet  transaction  timing  (data  transmission  lengths,  the  ac¬ 
knowledgement  transmission  lengths,  and  the  acknowledgement  window  size); 
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c)  to  measure  the  mean  packet  transfer  latency  through  the  network  bridge  (the 
amount  of  time  it  takes  to  pass  the  packet  from  one  side  of  the  bridge  to  the  other 
side); 

d)  to  measure  the  'Ack  reserve'  feature  of  the  bridge  (the  amount  of  time  the  bridge 
waits  for  the  acknowledgement  to  return  through  the  bridge). 

4.1.2  Test  Configuration 

Three  configurations  were  used  to  perform  the  protocol  characterization  tests;  two 
included  a  bridge  NIU  and  one  did  not.  These  configurations  are  shown  in  figures  4-1, 

4-2,  and  4-3.  The  figures  also  show  the  test  equipment  required.  All  measurements  were 
taken  using  a  network  configuration  unloaded  with  other  traffic. 

4.1.3  Test  Composition 

Eighty-six  test  measurements  were  taken  to  characterize  the  Nlli's  protocol.  The 
packet  information  listed  in  table  4-1  was  collected  as  noted  for  packets  with  1, 96,  192,  and 
236  characters  in  the  information  (data)  field. 


Table  4-1.  Protocol  Characterization  Test  Data 


Packet 

Information 

Data  Characters  per  Packet 

1  96  192  256 

Data  Packet  and  Acknowledgement 

X 

Y  Y 

X 

Data  Packet 

X 

A.  A 

X 

Data  Packet  AGC  Burst 

X 

X 

Data  Packet  Leading  Rags 

X 

X 

Data  Packet  Infoimation 

X 

X 

Data  Packet  Trailing  Flags 

X 

X 

Data  Packet  Carrier  Turn-off 

X 

X 

Acknowledgement  Window 

X 

X 

Acknowledgement  Packet  AGC  Burst 

X 

X 

Ack  Reserve  (Configuration  C  Only) 

X 

X 

Acknowledgement  Packet  Leading  Flags 

X 

X 

Acknowledgement  Packet  Information 

X 

X 

Acknowledgement  Packet  Trailing  Flags 

X 

X 

Acknowledgement  Packet  Carrier  Turn -off 

X 

X 

Figure  4-1 .  Protocol  Characterization  Configuration  A 
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Acknowledgement 


Figure  4-2.  Protocol  Characterization  Configuration 


13 


Figure  4-3.  Protocol  Characterization  Configuration  C 


4.1.4  Approach 


To  generate  the  desired  packet  size,  the  buftime  parameter  setting  (the  parameter  that 
controls  the  number  of  data  characters  contained  in  each  packet)  was  changed  from  its  default 
value.  It  was  necessary  to  do  this  each  time  a  different  packet  size  was  tested  to  allow  1 , 96, 
192,  or  256  character  packets  to  be  sent  over  the  network.  Once  the  buftime  parameter  was 
set,  a  virtual  circuit  was  established  and  testing  could  begin.  Separate  photographs  and  du¬ 
ration  measurements  were  taken  for  each  size  data  packet.  All  other  NIU  default  parameter 
settings  were  used  during  the  characterization  tests.  The  bridge  NIU's  address  switches 
were  set  to  allow  the  test  packets  to  pass  through  the  bridge. 


4.2  LOAD  EVALUATION  AND  END-TO-END  DELAY  PERFORMANCE 

These  tests  provided  a  vehicle  to  measure  the  channel  loading  and  resulting  delays 
based  on  various  traffic  transaction  types  and  mixes  of  traffic  transaction  types.  This  set  of 
tests  measured  the  channel  loading  of  the  four  types  of  ALC  LAN  traffic  transactions  and  the 
ttiree  types  of  word  processing  environment  traffic  transactions  observed  by  TRW  IND. 

4.2.1  Objectives 

The  objectives  of  the  test  were  threefold: 

a)  to  collect  network  load  characteristic  data  as  it  relates  to  the  incremental  addition 
of  virtual  circuits  to  the  network; 

b)  to  show  the  maximum  sustainable  channel  load; 

c)  to  collect  data  cn  the  one-way  end-to-end  delay  time  experienced  during  increased 
amounts  of  channel  load. 

Data  was  collected  for  various  traffic  transaction  types  and  traffic  transaction  type  mixes. 

4.2.2  Test  Configuration  and  Special  Equipment 

A  testbed  containing  544  NIU  ports  was  created.  Half  of  tl  ese  pons  were  dedicated 
to  the  load  generators  that  provided  the  network  traffic  transmissions  based  on  the  traffic- 
transaction  type  or  traffic  mix  of  interest.  The  other  half  of  the  ports  were  dedicated  to  the 
transmission  of  the  traffic  on  the  network;  these  ports  were  driven  by  the  load  generators  to 
which  they  were  connected.  A  maximum  of  136  virtual  circuits  could  be  made  using  the  544 
NIU  ports. 

In  addition  to  the  NIUs,  the  network  contained  a  number  of  taps  and  cables.  Figures 
4-4  and  4-5  show  the  testbed  configuration.  Since  the  network's  sole  function  was  to 
evaluate  traffic  loading,  no  propagation  delay  or  noise  was  built  into  the  configuration. 
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Figure  4-4.  Network  Performance  Testbed  Configuration 
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Figure  4-5.  Network  Test  Configuration 


The  specific  load  and  end-to-end  delay  testing  was  performed  using  unbridged, 
bridged,  and  cascade  bridged  network  configurations.  Figures  4-6  through  4-9  show  the 
configurations  for  each  of  the  tests.  The  two  bridged  network  configurations  were  not  con 
figured  to  offer  traffic  from  the  bridged  network  side.  Only  the  local  network  side  would 
offer  traffic  to  the  network. 

4.2.2. 1  Load  Generator 

A  load  generator  was  developed  using  a  standard  NIL'  with  the  software  modified  to 
simulate  asynchronous  activity  at  the  test  N1U  RS-232  ports.  Figure  4-10  shows  the  load 
generator  equipment  setup.  The  toad  generator  operated  on  a  different  channel  to  avoid  af¬ 
fecting  the  network.  One  load  generator  port  was  required  for  each  test  NIL  port  in  the  net¬ 
work.  One,  out  of  the  two  load  generator  ports  needed  to  support  a  virtual  circuit,  was  pro¬ 
grammed  to  be  the  "master"  that  controlled  the  network  activity  across  the  virtual  circuit. 

The  other  load  generator  port  was  the  "slave."  The  master  would  initiate  the  traffic  and 
command  the  slave  to  receive  and/or  transmit,  and  to  echo  or  not  echo  the  master's  transmis¬ 
sions.  The  load  generator  would  thus  allow  half  or  full  duplex,  echoplex  or  simplex  ex¬ 
changes. 

The  master  load  generator  was  configured  to  generate  the  traffic  transactions  desired 
over  the  network.  The  load  generator  stored  up  to  ten  different  traffic  scenarios  at  any  one 
time.  A  scenario  was  defined  by  six  parameters  assigned  to  it  --  namely,  Duty  Cycle, 

Hur.st  J  x,  BurstRx,  Echoplex,  CharRate,  and  Cycle  Time.  These  parameters  were  defined  in 
the  ft >1  lowing  way: 

Duty  Cycle  def  ined  the  frequency  of  repetition  of  a  given  scenario  cycle.  Periods  of 
activity  and  inactivity  within  a  given  cycle  were  randomly  distributed  by  a  pseudo  random 
number  generator. 

BurstTx  defined  the  number  of  characters  transmitted  from  a  load  generator  master  to 
a  slave  during  a  given  cycle. 

Burstkx  defined  the  number  of  characters  transmitted  from  a  load  generatoi  slave  to  a 
master  during  a  given  cycle. 

Echoplex  defined  the  number  of  characters  the  slave  would  echo  back  to  the  master 
during  a  given  cycle.  If  the  Echoplex  value  was  less  than  the  BurstTx  value,  the  slave  would 
echo  s  haracters  to  the  master  starting  with  the  first  character  transmitted,  until  the  echoplex 
value  was  reached. 
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IX 


Figure  4-6.  Unbridged  Test  Configuration 


Figure  4-7.  Bridged  Test  Configuration 


Figure  4-8.  Cascaded  Bridged  Test  Configuration 


f  igure  4-9.  Altered  Bridged  Test  Configuration  (Used  for  lest  25  Only) 


Figure  4-10.  Load  Generator  Equipment  Setup 


CharRate  defined  the  load  generator  transmission  rate  in  characters  per  second. 
CharRate  was  limited  by  the  baud  rate  and  the  data  character  parameters.  If  the  specified 
CharRate  exceeded  the  baud  rate  limitation,  the  resultant  CharRate  would  be  the  highest 
possible  given  these  restrictions.  For  example,  given  a  character  size  of  ten  bits  and  a  bit  rate 
of  4800  bps,  the  maximum  CharRate  obtainable  w'as  480  cps. 

Cycle  Time  defined  the  time  interval  reserved  for  a  given  scenario  transaction.  A 
transaction  was  initiated  by  a  master  at  the  start  of  the  cycle.  If  the  transaction  required  less 
time  than  the  Cycle  Time  reserved,  then  the  load  generator  w'ould  be  idle  for  the  remainder  of 
the  cycle.  The  Cycle  Time  was  greater  than  or  equal  to  the  time  required  for  the  transaction. 

Table  4-2  describes  the  nine  load  generator  scenario  settings  that  were  used  in  the 
network  performance  testing.  These  scenario  settings  correspond  with  the  traffic  type  load 
characteristics  described  in  section  3  of  this  document.  Scenarios  0,  1, 2,  and  3  correspond 
to  the  printer.  Type  1,  Type  2  and  Type  3  terminal  traffic  types.  Scenarios  4  and  5  are 
variations  of  the  original  Scenarios  1  and  3  (Type  1  and  Type  3  terminal  traffic  types).  Sce¬ 
nario  4  was  jointly  proposed  by  the  test  team.  This  modification  of  Scenario  1  decreased  the 
cycle  time  thus  doubling  the  offered  load  of  the  Type  1  terminal  traffic  type.  Scenario  5  was 
proposed  by  MITRE.  It  is  a  modification  of  Scenario  3  and  provided  continuous  echoplex 
traffic  double  that  of  the  Type  3  terminal  traffic  offered  in  Scenario  3.  Scenarios  6,  7,  and  8 
correspond  with  the  word  processing  traffic  types,  data  entry,  screen  refresh,  and  printer. 


Table  4-2.  Load  Generator  Settings 


Scenario 

Number 

Duly  Cycle 

% 

Burst  Tx 

(characters) 

Burst  Rx 
(characters) 

Echoplex 

(characters) 

CharRate 
(char/scc. ) 

Cycle  Time 
(seconds) 

(1 

Ml 

556 

0 

0 

0 

l 

1 

75 

SO 

1920 

80 

0 

120 

75 

80 

1920 

0 

0 

120 

75 

3 

0 

3 

3 

1 

4 

75 

80 

1920 

80 

0 

60 

5 

75 

6 

0 

6 

6 

1 

50 

5 

0 

5 

0 

1 

7 

25 

3 

1752 

0 

0 

60 

1 

4  580 

0 

0 

0 

5 
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4. 2. 2. 2  End-to-End  Test  Tool 

The  delay  test  measurement  tool  is  a  software  program  developed  for  use  on  the  IBM 
PC  XT.  The  end-to-end  delay  test  was  used  to  measure  the  amount  of  time  required  for  a 
single  data  character  to  be  transmitted  over  the  network.  The  delay  is  measured  from  the 
time  a  data  character  leaves  the  PC  port  through  the  transmit  line  of  an  RS-232  cable  to  an 
NIU  port,  to  the  time  it  arrives  back  through  the  receive  line  of  an  RS-232  cable  to  the  PC 
port.  Figure  4-1 1  shows  a  typical  test  configuration  used  for  the  end-to-end  delay  test.  At 
least  a  full  screen  of  characters  (approximately  1000  one-character  packets)  was  sent  before 
halting  the  delay  test.  After  the  characters  had  been  transmitted  over  the  network,  the  delay 
program  would  provide  the  delay  values  (in  milliseconds  (msec))  for  the  minimum,  50 
percent,  68.7  percent,  99.9  percent  and  maximum  end-to-end  delays. 

4. 2. 2. 3  LanTach 

To  measure  the  representative  traffic  load  operating  on  a  given  netw'ork  channel  in 
real  time,  the  TRW  IND  LanTach  product  was  used.  This  device  measures  the  ratio  of  car¬ 
rier  transmission  time  versus  idle  time  with  100  percent  representing  continuous  carrier 
present. 

A  four-channel  strip  chart  recorder  recorded  the  output  of  four  LanTachs.  Since  the 
LanTach  is  quite  sensitive  to  changes  in  traffic  load,  it  was  necessary  to  modify  the  output  to 
obtain  a  smoother,  more  easily  interpreted  traffic  load  curve.  Therefore,  three  of  the  four 
LanTachs  were  modified  with  a  400  microFarad  capacitor  so  that  the  traffic  load  could  be 
integrated  over  a  brief  period  with  an  instantaneous  average  measured.  The  fourth  LanTach 
measured  the  real-time  traffic  load.  By  recording  both,  the  measured  real-time  traffic  load 
could  be  compared  (if  necessary)  with  the  measured  average  traffic  load. 

4.2.3  Test  Composition 

Twenty-six  tests  evaluated  the  network  channel  load  and  end-to-end  delays  experi¬ 
enced  on  the  network.  Table  4-3  lists  the  performance  tests  and  their  composition.  The  table 
is  divided  into  four  parts:  test  number,  test  configuration  type,  parameter  settings,  and  per 
cent  load  generator  scenario  traffic  (local  and  bridged). 

Eighteen  tests  were  associated  with  pure  traffic  transaction  types.  Each  traffic  trans¬ 
action  type  was  tested  in  each  of  the  three  network  configurations.  In  the  unbridged  tests, 
100  percent  of  a  specific  traffic  transaction  type  or  scenario  was  used.  In  the  bridged  and 
cascaded  bridged  tests,  75  percent  of  the  specified  traffic  transaction  type  was  local  (not 
bridged)  and  25  percent  of  the  traffic  was  bridged. 
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Figure  4-11.  Delay  Measurement  Test  Configuration 


Table  4-3.  Test  Composition  of  Performance  Tests 
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Eight  tests  were  associated  with  proportional  mixes  of  the  traffic  transaction  types. 
The  proportions  of  the  traffic  transaction  type  or  scenario  varied.  Three  tests  were  per¬ 
formed  using  the  proportional  mix  defined  for  the  expected  traffic  on  the  ALC  LANs.  This 
mix  w'as  as  follows: 


Scenario  Proportion 

0  16.7% 

1  20.8% 

2  41.7% 

3  20.8% 

These  proportions  were  used  for  the  unbridged  network  configuration.  For  the 
bridged  network  configurations,  the  ratio  of  local  (not  bridged)  to  bridged  was  75:25. 
Therefore,  traffic  proportions  for  tests  that  required  either  type  of  bridged  traffic  were  as 
follows: 


Scenario 

Proportion 

local  0 

12.5% 

local  1 

15.6% 

local  2 

31.3% 

local  3 

15.6% 

bridged  0 

.2% 

bridged  1 

5.2% 

bridged  2 

10.4% 

bridged  3 

5.2% 

Three  other  tests  evaluated  the  channel  load  and  delay  associated  with  a  combination 
of  only  the  terminal  traffic  transaction  types  (Scenarios  1,  2,  and  3)  using  the  three  network 
configurations.  These  tests  determined  the  impact  of  printer  traffic  on  channel  loading.  The 
ALC  LAN  expected  proportional  mix  determined  the  proportion  of  scenarios  1,  2,  and  3;  the 
proportion  of  local  to  bridged  traffic  was  75:25. 

One  test  evaluated  the  channel  load  of  Scenarios  0,  1,2,  and  3  with  a  proportion  of 
local  to  bridged  traffic  of  (81.25):(18.75).  These  tests  determined  the  impact  of  the  propor¬ 
tion  of  local  to  bridged  traffic  on  channel  loading  and  delay. 

The  last  of  the  26  tests  evaluated  the  channel  load  of  the  word  processing  Scenarios 
6,  7,  and  8. 

4.2.4  Approach 

The  network(s)  were  initially  loaded  with  traffic  of  a  single  transaction  type  to  estab¬ 
lish  the  relative  loading  capability  of  each  type.  In  subsequent  tests,  proportional  mixes  of 
these  types  were  used  to  simulate  actual  network  conditions. 
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For  each  test,  the  number  of  virtual  circuit  transactions  was  increased  in  increments 
of  9  to  15  virtual  circuits.  Whenever  possible,  automated  scripts,  run  on  a  Macintosh  per¬ 
sonal  computer,  were  used  to  establish  the  virtual  circuits  and  initiate  the  load  generator  traf 
lie  transmissions.  An  end-to-end  delay  test  was  performed  at  each  additional  increment  of 
virtual  circuits. 


4.3  SENSITIVITY  EVALUATION 

These  tests  provided  insight  into  the  flexibility  of  the  N1U  and  its  adaptability  to 
various  traffic  load  characteristics.  Since  most  of  the  N1U  parameters  are  settable  in  the 
firmware,  these  tests  focused  on  changing  specific  NIU  parameter  settings  to  determine 
whether  NHJ  parameter  tuning  could  make  a  difference  in  the  operation  of  large,  heavily 
loaded  networks.  The  parameters  were  those  that  could  change  the  size  of  the  packets  sent 
over  the  network  and  the  protocol  timing. 

4.3.1  Objectives 

Three  parameters  were  evaluated  for  sensitivity  to  network  load  and  end-to-end  de¬ 
lay,  namely,  Buftime,  Acklatency,  and  Ack  reserve.  The  performance  of  the  default  settings 
of  these  parameters  was  compared  with  settings  modified  for  the  particular  traffic  of  interest. 
The  traffic  of  interest  was  determined  after  completion  of  the  network  load  and  end-to-end 
delay  testing.  In  this  way  it  could  be  determined  if  it  was  necessary  to  reduce  the  network 
loading  for  specific  traffic  transaction  types  and  achieve  better  performance  (as  determined 
with  the  loading  and  end-to-end  delays)  through  changes  in  NIU  parameters. 

The  Buftime  parameter  sets  the  packet  assembly  time.  'Buftime'  controls  the  amount 
of  possible  data  that  can  fit  into  a  packet.  When  the  first  character  comes  in  from  the  user 
device  and  is  placed  in  an  empty  buffer,  a  timer  is  initialized.  Every  ten  msec,  it  is  decre¬ 
mented.  When  the  counter  reaches  zero,  the  packet  is  ready  to  be  transmitted.  All  incoming 
characters  are  added  to  the  packet,  unless  the  buffer  size  (256  bytes)  is  exceeded.  If  the 
maximum  buffer  size  is  reached  before  the  timer  goes  off,  the  packet  is  automatically  trans¬ 
mitted.  By  modifying  this  parameter,  one  can  better  match  the  size  of  the  data  packet  to  the 
types  of  traffic  generated  and  optimize  performance.  The  default  setting  for  Buftime  is  3  (50 
msec). 


The  Acklatency  parameter  controls  the  amount  of  time  between  transmission  of  a  data 
packet  and  its  acknowledgement  packet.  During  this  time  only  the  receiving  NIU  is  allowed 
to  transmit.  This  parameter  is  critical  to  the  operation  of  the  NIU's  CSMA  with  prioritv 
acknowledgement  protocol.  All  senders  of  data  packets  avoid  conflict  with  the  acknowl¬ 
edgement  traffic  because  they  wait  for  the  'Acklatency'  period  before  transmitting  another 
data  packet.  In  essence,  the  Acklatency  parameter  reserves  a  time  slot  for  the 
acknowledgement  packet  to  be  transmitted  in  a  priority  manner  across  the  network.  The 
value  of  this  parameter  is  set  to  accommodate  the  expected  propagation  delay  on  the  network. 
By  modifying  this  parameter  to  correspond  with  the  network  propagation  delay,  the  channel 
time  available  for  data  transmission  can  be  maximized.  The  default  setting  for  Acklatency  is 
17  (170  msec). 
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The  Ack  reserve  parameter  of  the  bridge  initiates  a  hold  on  the  source  channel  after  a 
data  packet  has  passed  through  the  bridge  to  enable  the  acknowledgement  to  pass  through  the 
bridge  back  to  the  source  Nil)  without  colliding  with  anothei  packet.  The  jcsc rve  pa¬ 

rameter  sets  the  amount  of  time  allowed  for  an  acknowledgement  packet  to  return  through  the 
bridge  after  it  is  transmitted.  Like  the  Acklatency  parameter,  this  parameter  would  be  set  to 
accommodate  the  expected  propagation  delay  on  the  network.  It  should  be  set  to  be  less  than 
or  equal  to  the  Acklatency  parameter  setting.  By  properly  setting  this  parameter,  the  source 
channel  'hold'  time  is  minimized  thus  maximizing  the  potential  data  traffic.  The  default  set¬ 
ting  for  Ack  reserve  is  170  (170  msec). 

4.3.2  Test  Configuration 

This  testing,  like  the  network  load  evaluation  and  end-to-end  delay  testing,  used  un¬ 
bridged  and  bridged  network  configurations  in  the  testbed.  The  load  generators,  end-to-end 
delay  test  tool,  and  the  LanTach  were  also  used  (see  4.2.2). 

4.3.3  Test  Composition 

There  were  a  total  of  eleven  tests  conducted  to  determine  parameter  sensitivity. 

Table  4-4  lists  the  composition  and  NIU  test  parameters  for  the  sensitivity  tests.  This  table  is 
divided  into  four  parts:  test  number,  test  configuration  type,  parameter  settings,  and  percent 
load  generator  scenario  traffic  (local  and  bridged). 

Six  of  the  tests  were  performed  in  the  unbridged  test  configuration.  One  of  the  six 
tests  modified  the  buftime  parameter  setting  to  allow  a  larger  packet  size  for  the  printer  traf¬ 
fic.  The  other  tests  modified  the  Acklatency  parameter  setting  to  allow  less  time  between  the 
data  packet  and  its  acknowledgement  packet. 

The  remaining  five  tests  were  performed  in  the  bridged  test  configuration.  These 
tests  modified  the  Ack  reserve  parameter  setting  of  the  bridge,  to  allow  less  time  for  the 
bridge  to  hold  the  source  channel  for  the  acknowledgement  to  pass  back  through  the  bridge 
without  collision,  and  the  Acklatency  parameter  setting,  to  allow  less  time  between  the  data 
packet  and  its  acknowledgement  on  the  destination  channel. 

4.3.4  Approach 

The  tests  followed  the  same  steps  stated  in  the  approach  for  the  load  evaluation  and 
end-to-end  delay  test.  The  specific  NIU  parameter  under  test  was  set  prior  to  the  start  of 
testing. 
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Table  4-4.  Test  Composition  of  Sensitivity  Tests 
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SECTION  5 


RESULTS 


This  section  describes  the  results  of  the  three  phases  of  performance  testing. 


5.1  PROTOCOL  CHARACTERIZATION 

The  protocol  characterization  tests  focused  on  the  part  of  the  NIU  protocol  related  to 
data  transfers  across  an  established  virtual  circuit.  Thus,  the  data  packet  and  priority  ac¬ 
knowledgement  portions  of  the  protocol  were  highlighted.  Not  covered  during  the  testing 
was  a  characterization  of  the  datagram  messages.  Datagram  messages  are  typically  used  to 
query  the  network  or  respond  to  queries  from  the  network  especially  during  the  virtual  circuit 
establishment  process;  datagram  messages  do  not  require  acknowledgement. 

5.1.1  Packet  Structure 

The  fundamental  element  of  the  NIU  protocol  is  the  packet  frame.  The  data  is  framed 
by  leading  and  trailing  flags.  The  protocol  is  based  on  an  exchange  of  packets  which  encap¬ 
sulate  the  higher  level  information  required  for  reliable  information  transfer.  All  packets  are 
constructed  from  the  following  basic  pieces; 

a)  carrier-on; 

b)  leading  flags  of  variable  length; 

e)  header  field  of  18  bytes  including  two  byte  destination  address,  two  byte  packet 
version  number,  two  byte  packet  length,  one  byte  packet  type,  eight  byte  control 
field,  one  byte  sequence  number,  and  two  byte  source  address; 

d)  information  field  of  0  to  256  bytes  of  data  (or  datagram  message  information); 

e)  cyclical  redundancy  check  (CRC)  of  two  bytes  based  on  the  CCITT  CRC-16 
algorithm; 

0  trailing  flags  of  variable  length; 

g)  carrier-off. 


Upon  initiation  of  a  transmission  (with  no  carrier  detected  on  the  cable),  the  RF  mo¬ 
dem  w  ill  begin  with  16  bit  times  of  solid  carrier  to  allow  the  automatic  gain  control  ( AGC) 
circuitry  of  the  receivers  to  adjust  the  reception  gain.  At  the  conclusion  of  a  transmission, 
the  RF  modem  will  shut  down  within  16  bit  times  (also  called  carrier-off).  Figure  5-1 
shows  the  elements  of  a  typical  data  packet  and  acknowledgement  packet. 
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5.1.2  Packet  Timing 


At  a  transmission  rate  of  two  Mops,  a  bit  time  is  0.5  microseconds  (ps).  therefore, 
the  best  case  packet  transmission  time  is  as  follows: 

Best  Case  =  Packet  size  (bytes)  x  4  ps  per  byte 

During  packet  transmission  and  in  accordance  with  the  NRZI  zero  insertion  scheme,  a  zero 
bit  is  inserted  between  a  packet's  leading  and  trailing  flags  after  a  transmission  series  of  five 
consecutive  one  bits  in  a  row;  this  allows  for  special  sequences  of  consecutive  one  bits  to  be 
defined  for  flags,  aborts,  and  idle  lines.  The  best  case  packet  would  have  no  series  of  five 
consecutive  one  bits  in  a  row  and  the  worst  case  would  have  a  packet  of  all  one  bits.  Due  to 
the  uncertainty  related  to  the  additional  bits  added  to  the  data  stream,  the  actual  packet  trans¬ 
mission  duration  can  vary  as  much  as  16.7  percent  above  the  best  case.  Therefore,  the  worst 
case  packet  time  is  as  follows: 

Wo-st  Case  =  Best  Case  +  (Best  Case  x  16.7%) 

The  consequences  of  these  variations  can  be  seen  in  the  packet  timing  results. 

Table  5-1  presents  the  results  of  the  packet  information  measurements  for  the  three 
test  configurations. 

5.1.3  Summary 

Protocol  overhead  introduced  by  all  functional  control  layers  between  the  source  and 
destination  is  large.  For  each  packet  with  1  to  256  data  characters,  there  is  176  ps  to  195  ps 
of  non  information  overhead.  The  non-information  overhead  includes  the  AGC  burst,  lead¬ 
ing  flags,  header,  CRC,  trailing  flags,  and  carrier  turn-off.  When  the  acknowledegment 
packet  is  added  into  the  total  time  for  packet  transmission,  another  464  ps  to  487  ps  is 
added;  the  acknowledgement  packet  contains  the  same  overhead  components  as  the  data 
packet.  Without  any  propagation  delay,  the  acknowledgement  window  adds  another  1 1 1  ps 
to  120  ps  to  the  total  time  to  transmit  a  single  packet  and  receive  a  response.  This  translates 
into  approximately  99.5  percent  overhead  for  a  'best  case'  one  character  (of  data)  packet  and 
approximately  99.4  percent  overhead  for  a  'worst  case'  one  character  (of  data)  packet. 

Using  a  256  character  packet,  there  is  a  43  percent  improvement-  'best  case'  256  character 
packet  has  approximately  42.3  percent  overhead  and  a  'worst  case’  256  character  packet  has 
approximately  40.2  percent  overhead. 
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5.2  LOAD  AND  DELAY  SUMMARY 


The  load  and  delay  tests  focused  on  the  measurement  of  the  channel  loads  and  resul¬ 
tant  delays  caused  by  the  addition  of  the  traffic  transaction  types  presented  in  section  3. 

Since  the  propagation  delay  and  carrier  noise  level  affects  were  less  of  a  concern,  the  j-affic 
load  and  end-to-end  delays  were  measured  in  the  absence  of  either  of  these  factors. 

Table  5-2  presents  a  summary  of  the  results  of  the  load  and  end-to-end  delay  tests 
(Tests  1-26).  The  table  is  divided  into  five  parts:  test  number,  test  configuration,  the 
number  of  virtual  circuits  remaining  after  the  last  end-to-end  delay  test  measurement  was 
taken,  resultant  bus  load,  and  one-way  end-to-end  delay  time.  The  appendix  presents  more 
detailed  results  on  each  test's  end-to-end  delay  tables,  bus  load  vs.  background  traffic  charts, 
and  end-to-end  delay  vs.  bus  load  charts  for  each  incremental  virtual  circuit. 

5.2.1  Test  Comparisons 

Although  the  load  and  delay  tests  could  be  compared  in  a  number  of  different  group¬ 
ings,  for  our  purposes  the  tests  have  been  divided  into  three  groups. 

The  first  group  includes  the  pure  traffic  types:  printer  traffic  (Test  1),  Type  1  traffic 
(Test  2),  Type  2  traffic  (Test  3),  Type  3  traffic  (Test  4),  Type  1  traffic  doubled  (Test  17), 
Type  3  traffic  doubled  (Test  22).  These  tests  show  that  the  printer  traffic  generated  the 
highest  load;  40  percent  of  the  time  carrier  was  detected  on  the  network.  The  Type  3 
(echoplex)  traffic  also  generated  high  loads;  32  percent  of  the  time  carrier  was  detected  on  the 
network  in  Test  4  and  36  percent  of  the  time  in  Test  22.  Type  1  and  2  traffic  presented  the 
lowest  loads  with  all  tests  showing  carrier  on  10  percent  of  the  time  or  less. 

The  end-to-end  delays  for  the  first  group  show  the  printer  and  Type  3  traffic  exhibit¬ 
ing  the  greatest  mean  delays;  around  100  msec  with  loads  approaching  40  percent  carrier  on. 
Type  1  and  2  traffic  exhibited  relatively  low  mean  delays  on  the  order  of  20  msec. 

The  second  group  includes  the  different  mixes  of  traffic  types:  printer,  Type  1,  Type 
2,  and  Type  3  traffic  unbridged  and  bridged  (Tests  5  and  10);  Type  1,  Type  2,  and  Type  3 
traffic  unbridged  and  bridged  (Tests  16  and  18);  and  the  word  processor  traffic  unbridged 
('lest  26).  These  tests  show  that  bridging  reduced  the  overall  network  load  by  1  to  2 
percent,  presumably  by  distributing  the  load  between  the  local  and  bridged  networks.  By 
removing  the  printer  traffic  from  the  network,  the  load  was  reduced  significantly.  Tests  5 
and  10,  which  included  the  printer  traffic  exhibited  maximum  loads  on  the  order  of  24 
percent.  7'ests  16  and  18  which  excluded  the  printer  traffic,  exhibited  maximum  loads  on  the 
order  of  14  percent.  The  word  processing  traffic  (including  printer  traffic)  in  Test  26 
showed  a  maximum  load  of  30  percent,  slightly  higher  than  the  other  mixes  of  traffic  types. 

The  end-to-end  delays  for  the  second  group  show  increasing  delays  with  increasing 
loads.  7'he  word  processing  traffic  that  exhibited  the  highest  load  also  exhibited  the  highest 
mean  delay,  81  msec.  The  traffic  with  the  next  highest  load,  the  printer  and  three  terminal 
traffic  types,  had  delays  around  40  msec.  The  traffic  with  the  lowest  load,  the  three  terminal 
traf  fic  types  without  the  printer  traffic,  had  delays  around  25  msec. 


Table  5-2.  Summary  of  Network  Load  and  End-to-End  Delay  Results 
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The  third  group  includes  the  two  proportional  mixes  of  bridged  traffic  types  (Tests 
10  and  25).  These  two  tests  show  that  the  load  and  delay  remained  constant  even  when  the 
proportion  of  local  to  bridged  traffic  changed. 

5.2.2  Summary 

It  is  clear  from  the  traffic  load  curves  that  the  percentage  of  loading,  as  a  measure  of 
carrier  on  time,  leveled  off  at  around  40  percent.  Although  136  virtual  circuits  were 
established  during  each  test,  in  a  number  of  cases,  some  were  dropped  (after  20  attempts  to 
transmit  the  NIU  was  designed  to  disconnect  the  virtual  circuit)  due  to  very  high  traffic  loads 
on  the  network.  This  is  especially  apparent  in  the  tests  using  the  printer  and  echoplex  traffic. 

The  end-to-end  delay  clearly  increased  as  the  traffic  load  increased.  The  end-to-end 
delay  test  results  show  that  a  very  large  percentage  of  traffic,  on  the  order  of  75  percent, 
experience  delays  under  the  mean  delay.  Fifty  percent  of  the  traffic  experienced  delays  on 
the  order  of  under  40  msec  even  at  the  maximum  load  of  40  percent  carrier  on  time. 


5.3  SENSITIVITY 

The  sensitivity  tests  focused  on  the  measurement  of  the  channel  loads  and  delays  re¬ 
sulting  from  changes  in  specific  NIU  parameters.  Table  5-2  presents  a  summary  of  the  re¬ 
sults  of  the  sensitivity  tests  (Tests  27-37).  The  table  is  divided  into  five  parts:  test  number, 
test  configuration,  the  number  of  virtual  circuits  remaining  after  the  last  end-to-end  delay  test 
measurement  was  taken,  resultant  bus  load,  and  one-way  end-to-end  delay  time  (table  4-5 
lists  the  specific  parameter  setting  for  the  sensitivity  tests).  The  appendix  presents  more  de¬ 
tailed  results  on  each  test's  end-to-end  delay  tables,  bus  load  vs.  background  traffic  charts, 
and  end-to-end  delay  vs.  bus  load  charts  for  each  incremental  virtual  circuit. 

5.3.1  Test  Comparison 

Although  the  sensitivity  tests  could  be  compared  in  a  number  of  different  groupings, 
for  our  purposes  the  tests  have  been  divided  into  three  groups. 

The  first  group  contains  the  pure  traffic  types:  printer  traffic  (Tests  1,  27  and  28). 
Type  1  traffic  (Tests  2  and  29),  Type  2  traffic  (Tests  3  and  30),  Type  3  traffic  (Tests  4  and 
3 1 ).  These  tests  show  that  increases  in  the  Buftime  parameter  reduced  the  network  load  and 
resultant  end-to-end  delays  and  decreases  in  the  Acklatency  parameter  affected  little  change  in 
the  network  load  or  end-to-end  delays.  When  Buftime  was  reset  to  allow  larger  sized  pack¬ 
ets,  the  maximum  load  was  reduced  from  a  load  of  40  percent  carrier  on  time  (Tests  1  and 
28)  to  a  load  of  28  percent  carrier  on  time  (Test  27);  end-to-end  delays  for  Test  27  decreased 
to  a  mean  of  43  msec,  well  below  the  mean  delays  experienced  in  Tests  1  or  28  of  128  and 
142  msec,  respectively.  Changing  the  Acklatency  parameter  to  reflect  the  small  propagation 
delay  in  the  test  configuration  did  not  seem  to  affect  the  network  load  or  end-to-end  delay. 

The  second  group  includes  the  different  mixes  of  traffic  types,  printer.  Type  1,  Type 
2,  and  Type  3  traffic,  operating  on  an  unbridged  network  (Tests  5  and  32).  These  tests  show- 
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that  by  changing  the  Acklatency  parameter,  the  load  could  be  reduced  some  (from  24  percent 
to  20  percent)  by  decreasing  the  amount  of  time  the  Nil!  waited  for  the  channel  to  be  free. 

I  lowever,  there  was  no  real  corresponding  reduction  in  the  end-to-end  delays. 

The  third  group  includes  the  different  mixes  of  traffic  types,  printer.  Type  1,  Type  2, 
and  Type  3  traffic,  operating  on  a  bridged  network  (Tests  10  and  37).  These  two  tests  show 
that  the  load  and  delay  remained  constant  even  when  the  Acklatency  and  Ack  reserve 
parameters  were  changed  to  reflect  the  small  propagation  delay  in  the  test  configuration. 

5.3.2  Summary 

By  changing  certain  NIU  parameter  default  values  to  reflect  the  traffic  characteristics 
and  LAN  characteristics  (e.g.,  propagation  delay),  performance,  as  measured  by  the  traffic- 
load  and  end-to-end  delay,  does  improve.  The  most  significant  change  in  network  load  (and 
delay)  occurred  when  the  buftime  parameter  was  changed  to  allow  larger  data  packet  sizes 
for  the  printer  traffic  scenarios.  Changes  in  the  Acklatency  default  parameter  (and  Ack  re¬ 
serve  default  parameter  in  networks  that  are  bridged)  to  refect  the  propagation  delay  may 
contribute  to  reductions  in  load  or  end-to-end  delay  only  when  there  is  a  great  degree  of 
mismatch  between  the  default  parameter  value  and  the  true  network  delay. 


SECTION  6 


SUMMARY  AND  CONCLUSIONS 


This  paper  has  provided  a  description  of  the  ALC  LAN  system  performance  test  per¬ 
formed  by  the  test  team  of  TRW  IND,  TRW  SEDD,  and  MITRE.  These  system  perfor¬ 
mance  tests  confirmed  that  the  assumptions  used  in  earlier  analytical  models  were  appro- 
pi  op  rialc,  and  although  *'.c  mode1  did  nor  adequately  characterize  the  statistical  performance 
of  individual  network  channels  based  on  the  traffic  described  in  the  system  specification,  the 
model  results  were  comparable  to  the  results  of  these  tests. 

The  echoplex  and  word  processing  traffic  stressed  the  performance  of  this  network 
protocol  substantially.  Most  surprising  was  the  stress  caused  by  the  printer  traffic  scenarios. 
This  traffic  type  stressed  the  protocol  performance  the  most.  The  ALC  LANs  network  man¬ 
agers  should  consider  placing  the  printer  traffic  on  separate  channels  because  this  traffic  type 
affects  the  delays  for  all  non-printer  applications.  Users  are  less  concerned  about  the  end-to- 
end  delay  associated  with  obtaining  a  printed  copy  of  a  file  than  about  the  end-to-end  delay 
associated  with  an  interactive  session  with  a  host. 

Fine  tuning  of  certain  NIU  parameters  could  provide  the  users  with  better  perfor¬ 
mance.  The  NIU  tuning  should  be  approached  with  care  since  the  environment  of  the  ALCs 
is  often  unstable  due  to  frequent  personnel  moves.  Tuning  for  one  configuration  may  not  be 
appropriate  for  another. 

For  purposes  of  channel  allocation  and  planning,  one  must  look  at  the  number  of 
host  ports  on  a  particular  channel  rather  than  the  number  of  non-host  ports.  Traffic  charac¬ 
teristics,  especially  echoplex  traffic  types,  play  a  significant  role  in  the  network  using  the 
CSMA  priority  acknowledgement  protocol.  This  should  be  taken  into  consideration  when 
procuring  new  or  modifying  old  LMS.  AFLC  should  promote  procuring  systems  based  on 
modern  workstations  that  provide  file-by-file  interactions  (host  downloads  a  file  to 
workstation,  transactions  performed  locally,  workstation  uploads  file  to  host).  It  is 
anticipated  that  with  the  proliferation  of  modern  workstations  on  the  network,  the  network 
channel  load  and  the  network  contribution  (excluding  the  host  processing)  to  the  end-to-end 
delay  will  be  reduced. 

The  information  gained  from  this  testing  should  be  expanded  as  the  systems  are  fully 
implemented  and  better  traffic  definitions  are  known.  In  addition,  the  technical  control  and 
monitoring  (TCM)  system  should  provide  insight  into  the  utilization  of  the  networks  and 
should  be  relied  upon  when  fine-tuning  the  NIU  parameters.  If  high  network  traffic  loads 
exist,  Network  Managers  may  want  to  limit  the  percent  carrier-on  time  on  specific  network 
channels  to  avoid  the  shedding  of  links  due  to  very  high  traffic  loads  on  the  network;  addi¬ 
tional  channels  could  be  used  to  handle  the  off-loaded  traffic. 
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GLOSSARY 


Acronyms 


A  F  LO 

Air  Force  Logistics  Command 

AGC 

Automatic  gain  control 

ALC 

Air  Logistics  Center 

bps 

Bits  per  second 

COTS 

Commercial  off-the-shelf 

cps 

Characters  per  second 

crc 

Cyclical  redundancy  check 

CSMA 

Carrier  sense  multiple  access 

USD 

Electronic  Systems  Division 

L.AN 

Local  area  network 

LMS 

Logistic:;  management  systems 

msec 

Millisecond 

Mbps 

Million  bits  per  second 

NIIJ 

Network  interface  unit 

NRZI 

Non-return  to  zero  inverted 

IX  M 

Technical  control  and  monitoring 

TRW  INI) 

TRW  Information  Networks  Division 

TRW SHDD 

TRW  Systems  Engineering  and  Development  Division 

ps 

Microsecond 

wptn 

Words  per  minute 
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